Memory bank power coordination including concurrently performing a memory operation in a selected number of memory regions

ABSTRACT

Apparatuses and methods related to memory bank power coordination in a memory device are disclosed. A method for memory bank power coordination may include concurrently performing a memory operation by a threshold number of memory regions, such as banks or subarrays, and executing a command to cause a power budget operation associated with the memory operation to be performed, based at least in part on information stored in a budget area, such as a register. The threshold number of memory regions may be set based at least in part on a threshold power consumption value, and the number of memory regions to concurrently perform an operation may be controlled by a bank arbiter. A counter having a value representing the threshold number of memory regions may be decremented while performing an operation, or incremented upon completion of an operation, associated with one of the memory regions. A number of the memory regions may be selected to perform a processing-in-memory (PIM) operation.

TECHNICAL FIELD

The present disclosure relates generally to semiconductor memory andmethods, and more particularly, to apparatuses and methods related tomemory power coordination.

BACKGROUND

Memory devices are typically provided as internal, semiconductor,integrated circuits in computing systems. There are many different typesof memory including volatile and non-volatile memory. Volatile memorycan require power to maintain its data (e.g., host data, error data,etc.) and includes random access memory (RAM), dynamic random accessmemory (DRAM), static random access memory (SRAM), synchronous dynamicrandom access memory (SDRAM), and thyristor random access memory (TRAM),among others. Non-volatile memory can provide persistent data byretaining stored data when not powered and can include NAND flashmemory, NOR flash memory, and resistance variable memory such as phasechange random access memory (PCRAM), resistive random access memory(RRAM), and magnetoresistive random access memory (MRAM), such as spintorque transfer random access memory (STT RAM), among others.

Computing systems often include a number of processing resources (e.g.,one or more processors), which may retrieve and execute instructions andstore the results of the executed instructions to a suitable location. Aprocessor can comprise a number of functional units such as arithmeticlogic unit (ALU) circuitry, floating point unit (FPU) circuitry, and acombinatorial logic block, for example, which can be used to executeinstructions by performing logical operations such as AND, OR, NOT,NAND, NOR, and XOR, and invert (e.g., inversion) logical operations ondata (e.g., one or more operands). For example, functional unitcircuitry may be used to perform arithmetic operations such as addition,subtraction, multiplication, and division on operands via a number oflogical operations.

A number of components in a computing system may be involved inproviding instructions to the functional unit circuitry for execution.The instructions may be executed, for instance, by a processing resourcesuch as a controller and/or host processor. Data (e.g., the operands onwhich the instructions will be executed) may be stored in a memory arraythat is accessible by the functional unit circuitry. The instructionsand data may be retrieved from the memory array and sequenced and/orbuffered before the functional unit circuitry begins to executeinstructions on the data. Furthermore, as different types of operationsmay be executed in one or multiple clock cycles through the functionalunit circuitry, intermediate results of the instructions and data mayalso be sequenced and/or buffered.

In many instances, the processing resources (e.g., processor and/orassociated functional unit circuitry) may be external to the memoryarray, and data is accessed via a bus between the processing resourcesand the memory array to execute a set of instructions. Processingperformance may be improved in a processor-in-memory (PIM) device, inwhich a processor may be implemented internal and/or near to a memory(e.g., directly on a same chip as the memory array), which may reducetime in processing and may also conserve power. Data movement betweenand within arrays and/or subarrays of various memory devices, such asprocessing-in-memory devices, can affect processing time and/or powerconsumption.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A is a block diagram of an apparatus in the form of a computingsystem including a memory device in accordance with a number ofembodiments of the present disclosure.

FIG. 1B is another block diagram of an apparatus in the form of acomputing system including a memory device in accordance with a numberof embodiments of the present disclosure.

FIG. 1C is a block diagram of a bank of a memory device in accordancewith a number of embodiments of the present disclosure.

FIG. 1D is another block diagram of a bank of a memory device inaccordance with a number of embodiments of the present disclosure.

FIG. 2 is a schematic diagram illustrating a portion of a memory arrayincluding sensing circuitry in accordance with a number of embodimentsof the present disclosure.

FIG. 3 is yet another block diagram of an apparatus in the form of acomputing system including a memory device in accordance with a numberof embodiments of the present disclosure.

DETAILED DESCRIPTION

The present disclosure includes apparatuses and methods related tomemory power coordination. A number of embodiments of the presentdisclosure include a method of memory power coordination includingconcurrently performing a memory operation by a threshold number ofmemory regions and executing a command to cause a budget area to performa power budget operation associated with the memory operation.

A number of embodiments include an apparatus comprising a memorycomprising memory regions each comprising memory cells, a budget areaconfigured to store a threshold value corresponding to at least one ofthe memory regions to be enabled, and a controller configured to controlaccess to a second one of the memory regions beyond the at least one ofthe memory regions corresponding to the threshold value. In at least oneembodiment, the controller can be configured to execute a command tocause the budget area to perform a power budget operation; based atleast in part on a number of memory regions accessed by a bank arbiter.

A number of embodiments of the present disclosure can facilitate memorypower coordination in a more efficient manner as compared to previousapproaches. For example, embodiments include actively limiting powerconsumption based on a configurable threshold amount of power that isavailable to be consumed. For example, a number of memory regions thatcan perform operations concurrently can be limited for memory powercoordination.

In at least one embodiment, most data should vary or move betweendifferent memory regions (e.g., banks and subarrays) within aprocessor-in-memory (PIM), e.g., a PIM dynamic random access memory(DRAM) implementation. For example, data can vary or move betweendifferent banks and subarrays without being bused outside the banksand/or subarrays. As used herein, a “memory region” is a storage unit orstorage units configured to store logical or physical data in acomputing system. Examples of memory regions include banks, arrays,subarrays, etc., that may be configured to store data associated withthe computing system. Examples of computing systems that can includememory regions include DRAM (e.g., PIM DRAM), SDRAM, etc. Although someembodiments described herein make specific reference to banks and/orsubarrays, it will be appreciated that memory operations performed usingthe banks and/or subarrays may similarly be performed using memoryregions associated with a computing system.

Embodiments disclosed herein include mechanisms on a PIM DRAM that canactively control, e.g., reduce, mitigate, and/or minimize powerconsumption. For example, embodiments include mechanisms on a PIM thatcan actively limit at least a worst case scenario power consumption. Insome embodiments, such mechanisms can actively limit power consumptionbased at least in part on a configurable power threshold.

Embodiments herein disclose a PIM DRAM that can implement a selectablecapability to limit power consumption while data is written to multiplebanks in parallel, e.g., simultaneously, to avoid the need to performmultiple write sequences to achieve the same effect, and to provide alimit in power consumption. For example, apparatuses and methodsdescribed herein can facilitate limiting power consumption while writingdata to a plurality of locations between multiple banks and subarrays onthe same memory device simultaneously. Depending on the algorithms beingexecuted on a PIM DRAM device, for example, selectively limiting powerto a plurality of banks while data is written to a plurality of banks ina memory device and/or selectively limiting power to a plurality ofbanks and/or subarrays in a PIM DRAM device, disclosed techniques cansave significant time in setting up the environment for executing blocksof PIM operations. Such techniques can decrease the effective powerconsumption of a PIM DRAM device.

In at least one embodiment a bank arbiter coupled to a memory device canimplement a series of budget areas (e.g., registers, power budgetregisters, etc.) to set the memory regions (e.g., banks and/orsubarrays) to be subjected to power limitation. In at least oneembodiment, a command protocol for the dynamic random access memory(DRAM) part is augmented to indicate that writes, or masked writes, arebeing done in a manner that affects power limitation. As used herein, a“budget area” is hardware that is configured to store, read, and/orwrite bits of information. A budget area may be configured to store,read, and/or write bits of information simultaneously. Examples ofbudget areas include registers (e.g., power budget registers, subarraybudget registers, etc.). Although some embodiments described herein makespecific reference to power budget registers and/or subarray budgetregisters, it will be appreciated that operations carried out using apower budget register and/or a subarray budget register may be similarlyperformed using a budget area.

Previous approaches to bank power coordination can suffer fromshortcomings such as insufficient power limitation and/or brownout. Assuch, bank power coordination can be cumbersome and/or unrealistic to,for example, alter power limitation in PIM DRAM devices in accordancewith previous approaches.

A number of embodiments of the present disclosure can provide improvedparallelism and/or reduced power consumption in association withperforming bank and/or subarray operations as compared to previoussystems such as previous PIM systems and systems having an externalprocessor (e.g., a processing resource located external from a memoryarray, such as on a separate integrated circuit chip). For example, anumber of embodiments can provide for bank power coordination whenperforming fully complete compute functions such as integer add,subtract, multiply, divide, and CAM (content addressable memory)functions without transferring data out of the memory array and sensingcircuitry via a bus (e.g., data bus, address bus, control bus), forinstance. Such compute functions can involve performing a number oflogical operations (e.g., logical functions such as AND, OR, NOT, NOR,NAND, XOR, etc.). However, embodiments are not limited to theseexamples. For instance, performing logical operations can includeperforming a number of non-Boolean logic operations such as copy,compare, destroy, etc. As used herein, in some embodiments, bank and/orsubarray operations are intended to include PIM operations, e.g., PIMDRAM operations.

In the following detailed description of the present disclosure,reference is made to the accompanying drawings that form a part hereof,and in which is shown by way of illustration how one or more embodimentsof the disclosure may be practiced. These embodiments are described insufficient detail to enable those of ordinary skill in the art topractice the embodiments of this disclosure, and it is to be understoodthat other embodiments may be utilized and that process, electrical,and/or structural changes may be made without departing from the scopeof the present disclosure. As used herein, designators such as “N”, “M”,etc., particularly with respect to reference numerals in the drawings,indicate that a number of the particular feature so designated can beincluded. As used herein, “a number of” a particular thing can refer toone or more of such things (e.g., a number of memory arrays can refer toone or more memory arrays). A “plurality of” is intended to refer tomore than one of such things.

The figures herein follow a numbering convention in which the firstdigit or digits correspond to the drawing figure number and theremaining digits identify an element or component in the drawing.Similar elements or components between different figures may beidentified by the use of similar digits. For example, 150 may referenceelement “50” in FIG. 1, and a similar element may be referenced as 250in FIG. 2. As will be appreciated, elements shown in the variousembodiments herein can be added, exchanged, and/or eliminated so as toprovide a number of additional embodiments of the present disclosure. Inaddition, as will be appreciated, the proportion and the relative scaleof the elements provided in the figures are intended to illustratecertain embodiments of the present invention, and should not be taken ina limiting sense.

FIG. 1A is a block diagram of an apparatus in the form of a computingsystem 100 including a memory device 120 in accordance with a number ofembodiments of the present disclosure. As used herein, a memory device120, controller 140, channel controller 143, bank arbiter 145 (shown inFIG. 1B), memory array 130, sensing circuitry 150, logic circuitry 170,and/or cache 171 might also be separately considered an “apparatus.”

System 100 includes a host 110 coupled (e.g., connected) to memorydevice 120, which includes a memory array 130. Host 110 can be a hostsystem such as a personal laptop computer, a desktop computer, a digitalcamera, a smart phone, or a memory card reader, among various othertypes of hosts. Host 110 can include a system motherboard and/orbackplane and can include a number of processing resources (e.g., one ormore processors, microprocessors, or some other type of controllingcircuitry). The system 100 can include separate integrated circuits orboth the host 110 and the memory device 120 can be on the sameintegrated circuit. The system 100 can be, for instance, a server systemand/or a high performance computing (HPC) system and/or a portionthereof. Although the example shown in FIGS. 1A and 1B illustrates asystem having a Von Neumann architecture, embodiments of the presentdisclosure can be implemented in non-Von Neumann architectures, whichmay not include one or more components (e.g., a central processing unit(CPU), ALU, etc.) often associated with a Von Neumann architecture.

For clarity, the system 100 has been simplified to focus on featureswith particular relevance to the present disclosure. The memory array130 can be a DRAM array, SRAM array, STT RAM array, PCRAM array, TRAMarray, RRAM array, NAND flash array, and/or NOR flash array, forinstance. The array 130 can comprise memory cells arranged in rowscoupled by access lines (which may be referred to herein as word linesor select lines) and columns coupled by sense lines, which may bereferred to herein as data lines or digit lines. Although a single array130 is shown in FIG. 1, embodiments are not so limited. For instance,memory device 120 may include a number of arrays 130 (e.g., a number ofbanks of DRAM cells, NAND flash cells, etc.).

The memory device 120 includes address circuitry 142 to latch addresssignals provided over a data bus 156 (e.g., an I/O bus) through I/Ocircuitry 144. Status and/or exception information can be provided fromthe controller 140 on the memory device 120 to a channel controller 143,through a high speed interface (HSI) 141 (shown in FIG. 1B) including anout-of-band bus 157, which in turn can be provided from the channelcontroller 143 to the host 110. Address signals are received throughaddress circuitry 142 and decoded by a row decoder 146 and a columndecoder 152 to access the memory array 130. Data can be read from memoryarray 130 by sensing voltage and/or current changes on the data linesusing sensing circuitry 150. The sensing circuitry 150 can read andlatch a page (e.g., row) of data from the memory array 130. The I/Ocircuitry 144 can be used for bi-directional data communication withhost 110 over the data bus 156. The write circuitry 148 is used to writedata to the memory array 130.

Controller 140, e.g., bank control logic and/or sequencer, decodessignals provided by control bus 154 from the host 110. These signals caninclude chip enable signals, write enable signals, and address latchsignals that are used to control operations performed on the memoryarray 130, including data read, data write, and data erase operations.In various embodiments, the controller 140 is responsible for executinginstructions from the host 110 and sequencing access to the array 130.The controller 140 can be a state machine (e.g., hardware and/orfirmware in the form of an application specific integrated circuit(ASIC)), a sequencer, or some other type of controller. In someembodiments, the controller 140 can include cache 171. The controller140 can control an amount of power available to banks and/or subarraysby controlling a number of banks and/or subarrays that can perform anoperation at a given time and/or within a given timeframe.

For example, as described in more detail herein, controller 140 (shownin FIG. 1B) can be in communication with a bank arbiter and/or powerbudget register to allow only a certain number of subarrays and/or banks(shown in FIGS. 1C and 1D) to be accessed to perform a memory operationconcurrently or within a certain timeframe. As used herein, a “memoryoperation” includes logical operations and/or PIM operations (e.g.,logical operations, shift operations, and/or rotate operations within aPIM implementation).

Examples of the sensing circuitry 150 are described further below, e.g.,in FIG. 2. For instance, in a number of embodiments, the sensingcircuitry 150 can comprise a number of sense amplifiers and a number ofcompute components, which may serve as, and be referred to herein as anaccumulator, and can be used to perform logical operations (e.g., ondata associated with complementary data lines).

In a number of embodiments, the sensing circuitry 150 can be used toperform logical operations using data stored in array 130 as inputs andstore the results of the logical operations back to the array 130without transferring data via a sense line address access (e.g., withoutfiring a column decode signal). As such, various compute functions canbe performed using, and within, sensing circuitry 150 rather than (or inassociation with) being performed by processing resources external tothe sensing circuitry (e.g., by a processor associated with host 110and/or other processing circuitry, such as ALU circuitry, located on thememory device 120 (e.g., on controller 140 or elsewhere)).

In various previous approaches, data associated with an operand, forinstance, would be read from memory via sensing circuitry and providedto external ALU circuitry via I/O lines (e.g., via local I/O linesand/or global I/O lines). The external ALU circuitry could include anumber of registers and would perform compute functions using theoperands, and the result would be transferred back to the array via theI/O lines. In contrast, in a number of embodiments of the presentdisclosure, sensing circuitry 150 is configured to perform logicaloperations on data stored in memory array 130 and store the result backto the memory array 130 without enabling an I/O line (e.g., a local I/Oline) coupled to the sensing circuitry 150. The sensing circuitry 150can be formed on pitch with the memory cells of the array. Additionallogic circuitry 170 can be coupled to the sensing circuitry 150 and canbe used to store, e.g., cache and/or buffer, results of operationsdescribed herein.

As such, in a number of embodiments, circuitry external to array 130 andsensing circuitry 150 is not needed to perform compute functions as thesensing circuitry 150 can perform the appropriate logical operations toperform such compute functions without the use of an external processingresource. Therefore, the sensing circuitry 150 may be used to complementand/or to replace, at least to some extent, such an external processingresource (or at least the bandwidth consumption of such an externalprocessing resource).

However, in a number of embodiments, the sensing circuitry 150 may beused to perform logical operations (e.g., to execute instructions) inaddition to logical operations performed by an external processingresource (e.g., host 110). For instance, host 110 and/or sensingcircuitry 150 may be limited to performing only certain logicaloperations and/or a certain number of logical operations.

Enabling an I/O line can include enabling (e.g., turning on) atransistor having a gate coupled to a decode signal (e.g., a columndecode signal) and a source/drain coupled to the I/O line. However,embodiments are not limited to not enabling an I/O line. For instance,in a number of embodiments, the sensing circuitry (e.g., 150) can beused to perform logical operations without enabling column decode linesof the array; however, the local I/O line(s) may be enabled in order totransfer a result to a suitable location other than back to the array130 (e.g., to an external register).

FIG. 1B is a block diagram of another apparatus architecture in the formof a computing system 100 including a plurality of memory devices 120-1,. . . , 120-N coupled to a host 110 via a channel controller 143 inaccordance with a number of embodiments of the present disclosure. In atleast one embodiment the channel controller 143 may be coupled to theplurality of memory devices 120-1, . . . , 120-N in an integrated mannerin the form of a module 118, e.g., formed on the same chip with theplurality of memory devices 120-1, . . . , 120-N. In an alternativeembodiment, the channel controller 143 may be integrated with the host110, as illustrated by dashed lines 111, e.g., formed on a separate chipfrom the plurality of memory devices 120-1, . . . , 120-N. The channelcontroller 143 can be coupled to each of the plurality of memory devices120-1, . . . , 120-N via an address and control (A/C) bus 154 asdescribed in FIG. 1A which in turn can be coupled to the host 110. Thechannel controller 143 can also be coupled to each of the plurality ofmemory devices, 120-1, . . . , 120-N via a data bus 156 as described inFIG. 1A which in turn can be coupled to the host 110. In addition, thechannel controller 143 can be coupled to each of the plurality of memorydevices 120-1, . . . , 120-N via an out-of-band (OOB) bus 157 associatedwith a high speed interface (HSI) 141, described more herein, that isconfigured to report status, exception and other data information to thechannel controller 143 to exchange with the host 110.

As shown in FIG. 1B, the channel controller 143 can receive the statusand exception information from a high speed interface (HSI) (alsoreferred to herein as a status channel interface) 141 associated with abank arbiter 145 in each of the plurality of memory devices 120-1, . . ., 120-N. In the example of FIG. 1B, each of the plurality of memorydevices 120-1, . . . , 120-N can include a bank arbiter 145 to sequencecontrol and data with a plurality of banks, e.g., Bank zero (0), Bankone (1), . . . , Bank six (6), Bank seven (7), etc. Each of theplurality of banks, Bank 0, . . . , Bank 7, can include a controller 140and other components, including an array of memory cells 130 and sensingcircuitry 150, peripheral logic 170, etc., as described in connectionwith FIG. 1A.

In some embodiments, the respective controller 140-0, 140-1, . . . 140-Ncan be configured to control operations performed on the bank 121-0, . .. , 121-7 that is associated therewith. The bank arbiter 145-1 isconfigured to control which bank 121-0, . . . , 121-7 is to be enabledand/or which banks are to perform concurrent operations. For example,the banks 121-0, . . . , 121-7 can be configured to operateindependently of one another based on a command from the bank arbiter145-1. The command from the bank arbiter 145-1 may be based, at least inpart, on information received from the budget area (e.g., power budgetregister “PBR” 147-1).

Each of the plurality of banks, e.g., Bank 0, . . . , Bank 7, in theplurality of memory devices 120-1, . . . , 120-N can include addresscircuitry 142 (shown in FIG. 1A) to latch address signals provided overa data bus 156 (e.g., an I/O bus) through I/O circuitry 144. Statusand/or exception information can be provided from the controller 140 onthe memory device 120 to the channel controller 143, using the OOB bus157, which in turn can be provided from the plurality of memory devices120-1, . . . , 120-N to the host 110. For each of the plurality ofbanks, e.g., Bank 0, . . . , Bank 7, address signals can be receivedthrough address circuitry 142 and decoded by a row decoder 146 and acolumn decoder 152 to access the memory array 130. Data can be read frommemory array 130 by sensing voltage and/or current changes on the datalines using sensing circuitry 150. The sensing circuitry 150 can readand latch a page (e.g., row) of data from the memory array 130. The I/Ocircuitry 144 can be used for bi-directional data communication withhost 110 over the data bus 156. The write circuitry 148 is used to writedata to the memory array 130 and the 00B bus 157 can be used to reportstatus, exception and other data information to the channel controller143.

The channel controller 143 can include one or more local buffers 161 tostore program instructions and can include logic 160 to allocate aplurality of locations, e.g., subarrays, in the arrays of eachrespective bank to store bank commands, and arguments, e.g., PIMcommands, for the various banks associated with the operation of each ofthe plurality of memory devices 120-1, . . . , 120-N. The channelcontroller 143 can dispatch commands, e.g., PIM commands, to theplurality of memory devices 120-1, . . . , 120-N to store those programinstructions within a given bank of a memory device.

As described above in connection with FIG. 1A, the memory array 130 canbe a DRAM array, SRAM array, STT RAM array, PCRAM array, TRAM array,RRAM array, NAND flash array, and/or NOR flash array, for instance. Thearray 130 can comprise memory cells arranged in rows coupled by accesslines (which may be referred to herein as word lines or select lines)and columns coupled by sense lines, which may be referred to herein asdata lines or digit lines.

As in FIG. 1A, a controller 140, e.g., bank control logic and/orsequencer, associated with any particular bank, Bank 0, . . . , Bank 7,in a given memory device, 120-1, . . . , 120-N, can decode signalsprovided by control bus 154 from the host 110. These signals can includechip enable signals, write enable signals, and address latch signalsthat are used to control operations performed on the memory array 130,including data read, data write, and data erase operations. In variousembodiments, the controller 140 is responsible for executinginstructions from the host 110. And, as above, the controller 140 can bea state machine, a sequencer, or some other type of controller. That is,the controller 140 can control a number of banks and/or subarrays thatcan perform operations concurrently or within a given timeframe, therebylimiting an amount of power consumed in performing such operations in anarray, e.g., memory array 130.

According to embodiments, the controller 140 is configured to set aseries of budget areas (e.g., power budget registers 147) in a bankarbiter 145 and/or in logic circuitry 170. The controller 140 and/or thebank arbiter 145 are configured to facilitate bank power coordination tolimit power consumption, for example.

FIG. 1C is a block diagram of a bank 121-1 of a memory device inaccordance with a number of embodiments of the present disclosure. Thatis bank 121-1 can represent an example bank of a memory device such asBank 0, . . . , Bank 7 (121-0, . . . , 121-7) shown in FIG. 1B. As shownin FIG. 1C, a bank architecture can include a plurality of main memorycolumns (shown horizontally as X), e.g., 16,384 columns in an exampleDRAM bank. Additionally, the bank 121-1 may be divided up into banksections, 123-1, 123-2, . . . , 123-N, separated by amplificationregions for a data path. Each of the of the bank sections 123-1, . . . ,123-N can include a plurality of rows (shown vertically as Y), e.g.,each section may include 16,384 rows in an example DRAM bank. Exampleembodiments are not limited to the example horizontal and/or verticalorientation of columns and rows described here or the example numbersthereof.

As shown in FIG. 1C, the bank architecture can include logic circuitry170 (or 170/171), including extra sense amp stripes that may be used forregisters, cache 171, and data buffering, that are coupled to the banksections 123-1, . . . , 123-N. In some embodiments, the logic circuitry170 can represent another example of the cache 171 associated with thecontroller 140 or the logic 170 associated with the sensing circuitry150 and array 130 as shown in FIG. 1A. Further, as shown in FIG. 1C, thebank architecture can be associated with bank control, e.g., controller140. The bank control shown in FIG. 1C can, in an example, represent atleast a portion of the functionality embodied by and contained in thecontroller 140 shown in FIGS. 1A and 1B.

FIG. 1D is another block diagram of a bank 121 of a memory device inaccordance with a number of embodiments of the present disclosure. Thatis, bank 121 can represent an example bank of a memory device such asBank 0, . . . , Bank 7 (121-0, . . . , 121-7) shown in FIG. 1B. As shownin FIG. 1D, a bank architecture can include an address/control (A/C)path, e.g., bus, 153 coupled a bank arbiter 145. Again, the bank arbiter145 shown in FIG. 1D can, in at least one example, represent at least aportion of the functionality embodied by and contained in the memorycontroller 140 shown in FIGS. 1A and 1B. Also, as shown in FIG. 1D, abank architecture can include a data path, e.g., bus, 155, coupled to aplurality of control/data registers in an instruction and/or data, e.g.,program instructions (PIM commands), read path and coupled to aplurality of bank sections, e.g., bank section 123, in a particular bank121.

As shown in FIG. 1D, a bank section 123 can be further subdivided into aplurality of sub-arrays (or subarrays) 125-1, 125-2, . . . , 125-N againseparated by a plurality of sense amplifiers/sensing circuitry and logiccircuitry 150/170 as shown in FIG. 1A and described further inconnection with FIG. 2. In one example, a bank section 123 may bedivided into sixteen (16) subarrays. However, embodiments are notlimited to this example number.

FIG. 1D illustrates a register (e.g., a power budget register “PBR”) 147associated with the bank arbiter 145 and coupled to each of thesubarrays 125-1, . . . , 125-N in the bank 121. In at least oneembodiment, the plurality of subarrays 125-1, . . . , 125-N and/orportions of the plurality of subarrays may be referred to as a pluralityof locations for storing program instructions, e.g., PIM commands,and/or constant data, e.g., data to set up PIM calculations, to a banksection 123 in a memory device.

According to embodiments of the present disclosure, the bank arbiter 145shown in FIG. 1D is configured for bank power coordination on a memorydevice 120. Alternatively, bank power coordination may be provided bypower budget register 147.

Bank power coordination on the memory device 120 includes determiningand/or selecting a threshold number of banks and/or subarrays 125-1, . .. , 125-N, and/or bank sections 123-1, . . . , 123-N that can perform anoperation concurrently. For example, a memory device may have 64 banksable to perform an operation. In this example, if the threshold numberof banks that can concurrently perform an operation is 16, then only 16of the 64 banks can perform concurrent operations. In at least oneembodiment, a counter associated with the threshold number of banks thatcan perform a concurrent operation is decremented for each bank that isperforming an operation, and is incremented each time a bank completesan operation.

According to embodiments, signals received from the bank arbiter 145 (orsignals received external to the bank arbiter 145, e.g., from host 110)are used to set a budget area (e.g., a power budget register 147). Insome embodiments, the bank arbiter 145 is configured to limit an amountof power available to the banks 121 and/or subarrays 125. For example,the bank arbiter 145 is configured to allocate a number of banks, e.g.,banks 121-0, . . . , 121-7, shown in FIGS. 1B, 1C and 1D, subarrays,e.g., subarrays 125-1, . . . 125-N, shown in FIG. 1D, and/or banksections, e.g., bank sections 123-1, . . . , 123-N, shown in FIGS. 1Cand 1D, that can perform operations concurrently. The controller 140,bank arbiter 145, and/or register 147, include logic in the form ofhardware circuitry and/or application specific integrated circuitry(ASIC). The controller 140, bank arbiter 145, and/or register 147 canthus control a threshold amount of power available to the number ofbanks e.g., banks 121-0, . . . , 121-7, shown in FIGS. 1B, 1C and 1D,and/or subarrays, e.g., subarrays 125-1, . . . 125-N, shown in FIG. 1D,that can perform operations concurrently. In some embodiments, thememory regions (e.g., banks 121-0, . . . , 121-7 and/or subarrays 125-1,. . . 125-N) are configured to be independently enabled or disabled. Forexample, each memory region can be enabled or disabled independently ofthe other memory regions.

According to embodiments, the number of banks 121 and/or subarrays 125that can concurrently perform operations can be pre-resolved, e.g. by aprogrammer and/or provided to the host 110 and/or channel controller143, and provided from a channel controller to a bank arbiter 145 ineach of a plurality of memory devices 120-1, . . . , 120-N, as shown inFIG. 1B. As shown in FIG. 1D, in at least one embodiment, the bankarbiter 145 and/or register 147 is configured to use DRAM protocol andDRAM logical and electrical interfaces to control the number of banks121 and/or subarrays 125 that can perform concurrent operations.

In at least one embodiment the bank arbiter 145 is configured to limitpower consumption of the memory device 120 in a plurality of subarraysin a plurality of banks 121-0, . . . , 121-N (Bank 0, Bank 1, . . . ,Bank N) using the DRAM write path. For example, a plurality of banks121-0, . . . , 121-N (Bank 0, Bank 1, . . . , Bank N) are shown coupledto a memory device 120. Each respective bank 121-0, . . . , 121-N caninclude a plurality of subarrays, e.g., 125-1, . . . , 125-N and/orportions of subarrays for Bank 0, 126-0, . . . , 126-N for Bank 1, and127-0, . . . , 127-N for Bank N. Embodiments are not so limited;however, and the host 110, controller 140, and/or channel controller 143can be configured to limit power consumption of the memory device 120 ina plurality of subarrays 125 and/or portions of the plurality ofsubarrays in the plurality of banks 121-0, . . . , 121-N (Bank 0, Bank1, . . . , Bank N).

Operations of a plurality of banks 121 and/or subarrays 125 can becontrolled by bank arbiter 145 and/or register 147. The bank arbiter 145can communicate with the register 147 set to control a number of theplurality of banks (e.g., banks 121-0, . . . , 121-N illustrated in FIG.1B) to perform operations in parallel and for the plurality ofsubarrays, e.g., 125-0, . . . , 125-N for Bank 0, etc. In at least oneembodiment, the subarrays and/or portions of subarrays are differentamong the select ones of the plurality of banks.

Hence, bank power coordination can be provided via a bank arbiter 145and/or register 147 to each memory device 120 in a plurality of memorydevices 120-1, . . . , 120-N. In at least one embodiment, a series ofregisters (e.g., power budget register(s) 147) can be set to limit anumber of banks of the plurality of banks 121-0, . . . , 121-N in eachmemory device 120 that can perform an operation concurrently.

In some embodiments, as seen in FIG. 1B, the array of memory cells (130in FIG. 1A) includes a plurality of banks of memory cells 120-1, . . . ,120-N and the memory device 120 includes a bank arbiter 145 coupled toeach of the plurality of banks 120-1, . . . , 120-N. In suchembodiments, each bank arbiter 145 is configured to control a number ofbanks 120-1, . . . , 120-N and/or subarrays 125-1, . . . , 125-N thatcan perform concurrent operations. In some embodiments, the controller140 can then store instructions in the received instruction block and/orin the received constant data to a plurality of locations for theparticular bank as allocated by the host 110 and/or channel controller143. That is, the host 110 and/or channel controller 143 is configuredto address translate the plurality of locations for the bank arbiter 145to assign to banks of the memory device 120. In at least one embodiment,as shown in FIG. 1D, the plurality of locations includes a number ofsubarrays 125-1, . . . , 125-N in the DRAM banks 121-1, . . . , 121-7and/or portions of subarrays.

In at least one embodiment, a memory device 120 can be configured tocouple to a host 110 via a data bus 156 and a control bus 154. A bank(e.g., 121-0) can include a plurality of bank sections 123-0, . . . ,123-N and a plurality of subarrays 125-1, . . . , 125-N of memory cells130, wherein a respective subarray (e.g., 125-1) of the plurality ofsubarrays 125 is coupled to a respective bank (e.g., 121-0) of theplurality of banks 121-0, . . . , 121-N. Some embodiments can includesensing circuitry coupled to the plurality of subarrays 125 via aplurality of columns of the memory cells 130, the sensing circuitryincluding a sense amplifier and a compute component coupled to each ofthe columns. Some embodiments can further include a bank arbiter 145-1including a power budget register 147 coupled to the plurality ofsubarrays 125, and the power budget register 147 can be configured toassociate a threshold number of available concurrent data transfers withthe plurality of banks 121-0, . . . , 121-N.

Some embodiments can include a channel controller 143 coupled to thebank arbiter 145-1, wherein the channel controller 143 is configured todirect a data transfer associated with at least one bank (e.g., 121-0)of the plurality of banks 121-0, . . . , 121-N based on the thresholdnumber of available concurrent data transfers. In at least oneembodiment, the host 110 is configured to control the timing of anoperation of at least one bank (e.g., 121-0) of the plurality of banks121-0, . . . , 121-N based at least in part on a priority of theoperation being performed by the at least one bank (e.g., 121-0). Insome embodiments, the threshold number of available concurrent datatransfers can be a non-zero number between 1 and 8; however, examplesare not so limited and the threshold number can be more than 8.

In at least one embodiment, the bank arbiter 145-1 can include counter(e.g., 349 illustrated in FIG. 3) coupled to the power budget register147. The counter (e.g., 349 illustrated in FIG. 3) can be configured todecrement the threshold number of available concurrent data transfers inresponse to a bank among the plurality of banks executing an operation,and/or increment the threshold of available concurrent data transfers inresponse to a bank among the plurality of banks completing theoperation. For example, as described in more detail in connection withFIG. 3, the counter (e.g., 349 illustrated in FIG. 3) can be used toensure that the power budget is not exceeded.

In some embodiments, a plurality of controllers 140-0, . . . , 140-N canbe coupled to the plurality of banks 121-0, . . . , 121-N, and arespective controller (e.g., 140-0) among the plurality of controllers140-0, . . . , 140-N is coupled to a respective bank (e.g., 121-0) amongthe plurality of banks 121-0, . . . , 121-N. In at least one embodiment,a plurality of subarray budget registers (e.g., 359-0, . . . , 359-7“SBR” illustrated in FIG. 3) are coupled to the plurality of controllers140-0, . . . , 140-N, and a respective subarray budget register amongthe plurality of subarray budget registers can be coupled to arespective sequencer among the plurality of controllers 140-0, . . . ,140-N. In some embodiments, the respective subarray budget registers canbe configured to communicate power budget information associated withthe respective bank among the plurality of banks to the power budgetregister, as described in more detail in connection with FIG. 3.

In some embodiments, memory device 120 can include sensing circuitry150. Examples of the sensing circuitry 150 are described further below(e.g., in FIG. 2). For instance, in a number of embodiments, the sensingcircuitry 150 can include a number of sense amplifiers and correspondingcompute components, which may serve as an accumulator and can be used toperform logical operations (e.g., on data associated with complementarysense lines). The sensing circuitry 150 can be used to reverse datastored in memory (e.g., in array 130) in accordance with embodimentsdescribed herein.

In a number of embodiments, the sensing circuitry 150 can also be usedto perform logical operations (e.g., logical functions such as AND, OR,NOT, NOR, NAND, XOR, etc.) using data stored in memory array 130 asinputs and participate in movement of the data for writing and storageoperations back to a different location in the memory array 130 withouttransferring the data via a sense line address access (e.g., withoutfiring a column decode signal). As such, various compute functions canbe performed using, and within, sensing circuitry 150 rather than (or inassociation with) being performed by processing resources external tothe sensing circuitry 150 (e.g., by a processor associated with host 110and other processing circuitry, such as ALU circuitry, located on thememory device 120, such as on controller 140 or elsewhere).

In various previous approaches, data associated with an operand, forinstance, would be read from memory via sensing circuitry and providedto external ALU circuitry via I/O lines (e.g., via local I/O lines andglobal I/O lines). The external ALU circuitry could include a number ofregisters and would perform compute functions using the operands, andthe result would be transferred back to the array via the I/O lines. Incontrast, in a number of embodiments of the present disclosure, sensingcircuitry 150 is configured to perform logical operations on data storedin memory array 130 and store the result back to the memory array 130without enabling a local I/O line and global I/O line coupled to thesensing circuitry 150. The sensing circuitry 150 can be formed on pitchwith the memory cells of the array. Additional peripheral logic 170,which can include an additional number of sense amplifiers, can becoupled to the sensing circuitry 150. The sensing circuitry 150 and theperipheral logic 170 can cooperate in performing logical operationsand/or in reversing data stored in memory, according to a number ofembodiments described herein.

FIG. 2 is a schematic diagram illustrating a portion of a memory array230 including sensing circuitry in accordance with a number ofembodiments of the present disclosure. The sensing component 250represents one of a number of sensing components that can correspond tosensing circuitry 150 shown in FIG. 1.

In the example shown in FIG. 2, the memory array 230 is a DRAM array of1T1C (one transistor one capacitor) memory cells in which a transistorserves as the access device and a capacitor serves as the storageelement; although other embodiments of configurations can be used (e.g.,2T2C with two transistors and two capacitors per memory cell). In thisexample, a first memory cell comprises transistor 202-1 and capacitor203-1, and a second memory cell comprises transistor 202-2 and capacitor203-2, etc. In a number of embodiments, the memory cells may bedestructive read memory cells (e.g., reading the data stored in the celldestroys the data such that the data originally stored in the cell isrefreshed after being read).

The cells of the memory array 230 can be arranged in rows coupled byaccess lines 204-X (Row X), 204-Y (Row Y), etc., and columns coupled bypairs of complementary sense lines (e.g., digit lines 205-1 labelledDIGIT(n) and 205-2 labelled DIGIT(n) in FIG. 2). Although only one pairof complementary digit lines are shown in FIG. 2, embodiments of thepresent disclosure are not so limited, and an array of memory cells caninclude additional columns of memory cells and digit lines (e.g., 4,096,8,192, 16,384, etc.).

Memory cells can be coupled to different digit lines and word lines. Forinstance, in this example, a first source/drain region of transistor202-1 is coupled to digit line 205-1, a second source/drain region oftransistor 202-1 is coupled to capacitor 203-1, and a gate of transistor202-1 is coupled to word line 204-Y. A first source/drain region oftransistor 202-2 is coupled to digit line 205-2, a second source/drainregion of transistor 202-2 is coupled to capacitor 203-2, and a gate oftransistor 202-2 is coupled to word line 204-X. A cell plate, as shownin FIG. 2, can be coupled to each of capacitors 203-1 and 203-2. Thecell plate can be a common node to which a reference voltage (e.g.,ground) can be applied in various memory array configurations.

The digit lines 205-1 and 205-2 of memory array 230 are coupled tosensing circuitry 250 in accordance with a number of embodiments of thepresent disclosure. In this example, the sensing circuitry 250 comprisesa sense amplifier 206 and a compute component 231 corresponding to arespective column of memory cells (e.g., coupled to a respective pair ofcomplementary digit lines). The sense amplifier 206 is coupled to thepair of complementary digit lines 205-1 and 205-2. The compute component231 is coupled to the sense amplifier 206 via pass gates 207-1 and207-2. The gates of the pass gates 207-1 and 207-2 can be coupled toselection logic 213.

The selection logic 213 can include pass gate logic for controlling passgates that couple the pair of complementary digit lines un-transposedbetween the sense amplifier 206 and the compute component 231, and swapgate logic for controlling swap gates that couple the pair ofcomplementary digit lines transposed between the sense amplifier 206 andthe compute component 231. The selection logic 213 can be coupled to thepair of complementary digit lines 205-1 and 205-2 and configured toperform logical operations on data stored in array 230. For instance,the selection logic 213 can be configured to control continuity of(e.g., turn on/turn off) pass gates 207-1 and 207-2 based on a selectedlogical operation that is being performed.

The sense amplifier 206 can be operated to determine a data value (e.g.,logic state) stored in a selected memory cell. The sense amplifier 206can comprise a cross coupled latch 215 (e.g., gates of a pair oftransistors, such as n-channel transistors 227-1 and 227-2 are crosscoupled with the gates of another pair of transistors, such as p-channeltransistors 229-1 and 229-2), which can be referred to herein as aprimary latch. However, embodiments are not limited to this example.

In operation, when a memory cell is being sensed (e.g., read), thevoltage on one of the digit lines 205-1 or 205-2 will be slightlygreater than the voltage on the other one of digit lines 205-1 or 205-2.An ACT signal and an RNL* signal can be driven low to enable (e.g.,fire) the sense amplifier 206. The digit line 205-1 or 205-2 having thelower voltage will turn on one of the transistors 229-1 or 229-2 to agreater extent than the other of transistors 229-1 or 229-2, therebydriving high the digit line 205-1 or 205-2 having the higher voltage toa greater extent than the other digit line 205-1 or 205-2 is drivenhigh.

Similarly, the digit line 205-1 or 205-2 having the higher voltage willturn on one of the transistors 227-1 or 227-2 to a greater extent thanthe other of the transistors 227-1 or 227-2, thereby driving low thedigit line 205-1 or 205-2 having the lower voltage to a greater extentthan the other digit line 205-1 or 205-2 is driven low. As a result,after a short delay, the digit line 205-1 or 205-2 having the slightlygreater voltage is driven to the voltage of the supply voltage Vccthrough a source transistor, and the other digit line 205-1 or 205-2 isdriven to the voltage of the reference voltage (e.g., ground) through asink transistor. Therefore, the cross coupled transistors 227-1 and227-2 and transistors 229-1 and 229-2 serve as a sense amplifier pair,which amplify the differential voltage on the digit lines 205-1 and205-2 and operate to latch a data value sensed from the selected memorycell.

Embodiments are not limited to the sensing component configurationillustrated in FIG. 2. As an example, the sense amplifier 206 can be acurrent-mode sense amplifier and/or a single-ended sense amplifier(e.g., sense amplifier coupled to one digit line). Also, embodiments ofthe present disclosure are not limited to a folded digit linearchitecture such as that shown in FIG. 2.

As described further below, the sensing component 250 can be one of aplurality of sensing components selectively coupled to a shared I/Oline. As such, the sensing component 250 can be used in association withreversing data stored in memory in accordance with a number ofembodiments of the present disclosure.

In this example, the sense amplifier 206 includes equilibrationcircuitry 214, which can be configured to equilibrate the digit lines205-1 and 205-2. The equilibration circuitry 214 comprises a transistor224 coupled between digit lines 205-1 and 205-2. The equilibrationcircuitry 214 also comprises transistors 225-1 and 225-2 each having afirst source/drain region coupled to an equilibration voltage (e.g.,VDD/2), where VDD is a supply voltage associated with the array. Asecond source/drain region of transistor 225-1 is coupled to digit line205-1, and a second source/drain region of transistor 225-2 is coupledto digit line 205-2. Gates of transistors 224, 225-1, and 225-2 can becoupled together and to an equilibration (EQ) control signal line 226.As such, activating EQ enables the transistors 224, 225-1, and 225-2,which effectively shorts digit lines 205-1 and 205-2 together and to theequilibration voltage (e.g., VDD/2). Although FIG. 2 shows senseamplifier 206 comprising the equilibration circuitry 214, embodimentsare not so limited, and the equilibration circuitry 214 may beimplemented discretely from the sense amplifier 206, implemented in adifferent configuration than that shown in FIG. 2, or not implemented atall.

As shown in FIG. 2, the compute component 231 can also comprise a latch,which can be referred to herein as a secondary latch 264. The secondarylatch 264 can be configured and operated in a manner similar to thatdescribed above with respect to the primary latch 215, with theexception that the pair of cross coupled p-channel transistors (e.g.,PMOS transistors) included in the secondary latch can have theirrespective sources coupled to a supply voltage (e.g., VDD), and the pairof cross coupled n-channel transistors (e.g., NMOS transistors) of thesecondary latch can have their respective sources selectively coupled toa reference voltage (e.g., ground), such that the secondary latch iscontinuously enabled. The configuration of the compute component 231 isnot limited to that shown in FIG. 2, and various other embodiments arefeasible.

FIG. 3 is yet another block diagram of an apparatus in the form of acomputing system including a memory device in accordance with a numberof embodiments of the present disclosure. In the example of FIG. 3, abank arbiter 345, including a power budget register 347 and counter 349,can be configured for bank power coordination on a memory device. In atleast one embodiment, each respective bank 321-0, . . . , 321-7 caninclude 64 subarrays 325-0, . . . , 325-N, 326-0, . . . , 326-N, 327-0,. . . , 327-N. Embodiments are not so limited; however, and therespective banks 321-0, . . . , 321-7 can include more or fewer than 64subarrays 325-0, . . . , 325-N, 326-0, . . . , 326-N, 327-0, . . . ,327-N.

As illustrated in FIG. 3, the bank arbiter 345 can be in communicationwith a plurality of banks 321-0, . . . 321-N. Each bank (e.g., 320-0) ofthe plurality of banks 321-0, . . . , 321-N can include a respectivecontroller 340, subarray budget register 359, and/or a plurality ofsubarrays 325, 326, 327, etc. In at least one embodiment, the subarraybudget registers 359-0, . . . , 359-N can be in communication with thepower budget register 347 and can communicate power budget informationregarding the subarrays 325, 326, 327 associated with a respective bank321-0, . . . , 321-N to the power budget register 347. For example, eachrespective subarray budget register 359-0, . . . , 359-7 can communicatepower information (e.g., how much power an operation or operations willconsume, how much power is available to perform an operation on asubarrays or plurality of subarrays, etc.) to the power budget register347. In this regard, the power budget register 347 can act as a sharedregister and can control a number of banks 321 and/or subarrays 325,326, 327 that can perform concurrent operations at a given time orwithin a given time period.

In at least one embodiment, the power budget register 347 can control amaximum number of banks 321-0, . . . , 321-N that can perform anoperation concurrently. In the example of FIG. 3, there are eight banks(e.g., BANK#0 through BANK #7). As a non-limiting example, the powerbudget register 347 can be configured such that no more than four bankscan perform an operation concurrently based on the counter 349. Forexample, if the power budget register 347 is configured to allow no morethan four banks to perform concurrent operations, and three banks areready to perform their respective operations, the power budget register347 will allow the three banks to perform their respective operations.However, if five banks are ready to perform their respective operations,the power budget register 347 can deny the respective operations to thebanks.

In at least one embodiment, bank power coordination can be achieved viaan apparatus comprising a memory device, a plurality of banks 321-0, . .. , 321-N, each of the plurality of banks 321-0, . . . , 321-N includinga plurality of subarrays 325-0, . . . , 325-N of memory cells, and abank arbiter 345 coupled to the plurality of banks 321-0, . . . , 321-N.In some embodiments, the bank arbiter 345 can include a power budgetregister 347 configured to allow a threshold number of availableconcurrent data transfers within the plurality of banks 321-0, . . . ,321-N.

As an additional non-limiting example, if the power budget register 347is configured to allow no more than five banks to perform respectiveoperations concurrently and three banks are ready to perform theirrespective operations, the power budget register 347 will allow thethree banks to perform their respective operations. If three additionalbanks are prepared to perform operations while the first three banks arestill performing operations, the power budget register 347 will deny therespective operations to the second three banks until at least one ofthe first group of banks has completed a respective operation. That is,the power budget register 347 can be configured such that no more thanthe allotted number of banks can be performing respective operationsconcurrently. As will be appreciated by those in the art, the powerbudget register 347 can provide power coordination by limiting thenumber of subarrays 325, 326, 327, etc. in addition to or in lieu ofbank power coordination via the banks 321-0, . . . , 321-7. That is, inat least one embodiment, the power budget register 347 can, via therespective subarray budget registers 359-0, . . . , 359-7, control anumber of subarrays that can perform respective concurrent operations.

In at least one embodiment, a method for bank power coordination caninclude concurrently performing a memory operation by a threshold numberof subarrays and executing a command to cause a power budget register toperform a bank power coordination operation associated with the memoryoperation. In some embodiments, the method can further include providinga counter having a value representing the threshold number of subarraysto concurrently perform the memory operation. The method can alsoinclude decrementing a counter corresponding to the threshold number ofsubarrays while performing the operation associated with a subarrayamong a plurality of subarrays. In some embodiments, the method caninclude incrementing a counter corresponding to the threshold number ofsubarrays when the operation associated with a subarray among theplurality of subarrays is completed. In some embodiments, the method canfurther include setting the threshold number of subarrays toconcurrently perform a respective memory operation based at least inpart on a threshold power consumption value. In addition, as describedherein, executing the command can be in association with a processor inmemory (PIM) device and/or the power budget register operation or bankpower coordination operation can be performed based at least in part onthe threshold number of subarrays.

In at least one embodiment, an apparatus for bank power coordination caninclude an array of memory cells, sensing circuitry coupled to thearray, and a bank arbiter including a register coupled to a controller.In at least one embodiment, the sensing circuitry can include a senseamplifier and a compute component configured to implement logicaloperations, the controller can be configured to execute a command tocause a power budget operation to be performed, and the register can beconfigured to control a threshold number of subarrays that canconcurrently perform a subarray operation.

In some embodiments, the apparatus can include a counter associated withat least one of the number of subarrays, wherein the counter isconfigured to decrement based on a subarray among the number ofsubarrays performing a subarray operation. The counter can be configuredto increment upon completion of the subarray operation. In someembodiments, the controller can be configured to execute a command tocause the register to assign a threshold amount of power to be consumedby the concurrently performed subarray operations, execute the commandto cause the register to perform the power budget operation based atleast in part on a number of banks accessed by the bank arbiter, and/orexecute the command to cause the register to perform the power budgetoperation based at least in part on the threshold number of subarrayswithin a bank.

In at least one embodiment, a method for bank power coordination caninclude receiving a command at a controller on a memory device,providing a counter corresponding to a threshold number of banks toconcurrently perform an operation, decrementing the counter whileperforming the operation associated with a particular bank among aplurality of banks, and incrementing the counter upon completing theoperation associated with the particular bank among the plurality ofbanks. In at least one embodiment, the plurality of banks can be in aprocessor in memory (PIM) device.

In some embodiments, the method can include denying the operationassociated with the particular bank among the plurality of banks basedon the counter having a value of zero. The counter can be associatedwith the bank arbiter, and the bank arbiter can control the thresholdnumber of banks to concurrently perform the memory operation. In someembodiments, the counter can be associated with the register, forexample, a power budget register, and the register can be coupled to thebank arbiter and configured to control the threshold number of banks toconcurrently perform the memory operation.

The method can further include denying the operation associated with theparticular subarray among the plurality of subarrays based on thethreshold number associated with the counter being exceeded. In someembodiments, the counter can be associated with a register, for example,a power budget register. In at least one embodiment, the plurality ofsubarrays and the register can be included in a processor in memorydevice as described herein.

As described herein, bank power coordination can include selecting anumber of banks among a plurality of banks to perform a respectivememory operation, wherein the number of selected banks is less than atotal number of the plurality of banks, and performing the respectivememory operation on each of the selected banks, wherein the number ofbanks selected is controlled by a bank arbiter coupled to the pluralityof banks. In some embodiments, the method can include decrementing acounter associated with the number of selected banks in response to arespective bank among the number of banks performing a respective memoryoperation, and/or incrementing the counter in response to the respectivebank completing the respective memory operation.

In at least one embodiment, bank power coordination can be provided byan apparatus including a first number of subarrays associated with afirst bank, a second number of subarrays associated with a second bank,and a bank arbiter coupled to the first bank and the second bank. In atleast one embodiment, the bank arbiter can control a threshold amount ofpower available to perform a memory operation by at least one of thefirst number of subarrays, the first bank, the second number ofsubarrays, and the second bank. In some embodiments, the apparatus caninclude a register coupled to the bank arbiter. In at least oneembodiment, the register can allocate a threshold amount of poweravailable to perform a memory operation by at least one of the firstnumber of subarrays, the first bank, the second number of subarrays, andthe second bank.

Although specific embodiments have been illustrated and describedherein, those of ordinary skill in the art will appreciate that anarrangement calculated to achieve the same results can be substitutedfor the specific embodiments shown. This disclosure is intended to coveradaptations or variations of one or more embodiments of the presentdisclosure. It is to be understood that the above description has beenmade in an illustrative fashion, and not a restrictive one. Combinationof the above embodiments, and other embodiments not specificallydescribed herein will be apparent to those of skill in the art uponreviewing the above description. The scope of the one or moreembodiments of the present disclosure includes other applications inwhich the above structures and methods are used. Therefore, the scope ofone or more embodiments of the present disclosure should be determinedwith reference to the appended claims, along with the full range ofequivalents to which such claims are entitled.

In the foregoing Detailed Description, some features are groupedtogether in a single embodiment for the purpose of streamlining thedisclosure. This method of disclosure is not to be interpreted asreflecting an intention that the disclosed embodiments of the presentdisclosure have to use more features than are expressly recited in eachclaim. Rather, as the following claims reflect, inventive subject matterlies in less than all features of a single disclosed embodiment. Thus,the following claims are hereby incorporated into the DetailedDescription, with each claim standing on its own as a separateembodiment.

What is claimed is:
 1. A method, comprising: setting, by a controller, acounter having a value corresponding to a threshold number of memoryregions that can concurrently perform a memory operation; concurrentlyperforming the memory operation using the threshold number of memoryregions in a memory device to concurrently perform the memory operation;executing, by the controller coupled to a power budget register in thememory device, a command to perform a power budget operation, based oninformation stored in the power budget register, associated with thememory operation, wherein the power budget operation includes limitingan amount of power available to the threshold number of memory regionsfor use in concurrently performing the memory operation; anddecrementing, by the controller, the counter while concurrentlyperforming the memory operation; incrementing, by the controller, thecounter in response to completion of performance of the memoryoperation; and storing a result of the memory operation in at least oneof the memory regions without transferring the result of the memoryoperation to circuitry external to the memory device.
 2. The method ofclaim 1, further comprising setting the threshold number of memoryregions to concurrently perform a respective memory operation based atleast in part on a threshold power consumption value.
 3. The method ofclaim 1, further comprising executing the command in aprocessor-in-memory (PIM) device.
 4. An apparatus, comprising: a memorycomprising a plurality of memory regions each comprising memory cells; apower budget register coupled to the memory; and a controller coupled tothe memory and the power budget register, wherein the controller isconfigured to: set a counter having a value corresponding to a thresholdnumber of memory regions allowed to concurrently perform a memoryoperation; cause a power budget operation to be performed based, atleast in part, on information stored in the power budget register thatcorresponds to an amount of power available to the memory regions toconcurrently perform the memory operation and on the value correspondingto the threshold number of memory regions allowed to concurrentlyperform the memory operation; and allow an additional one of the memoryregions to perform the memory operation, in addition to the thresholdnumber of memory regions allowed to concurrently perform the memoryoperation, while the counter is greater than one, based on theinformation stored in the power budget register; and store a result ofthe memory operation in the additional one of the memory regions withouttransferring the result of the memory operation to circuitry external tothe memory.
 5. The apparatus of claim 4, wherein each of the memoryregions is a respective bank of a plurality of banks of the memory. 6.The apparatus of claim 4, wherein each of the memory regions is arespective subarray of a plurality of subarrays of the memory.
 7. Theapparatus of claim 4, wherein the counter is configured to decrementbased on a memory region among the plurality of memory regionsperforming the memory operation.
 8. The apparatus of claim 4, whereinthe counter is configured to increment upon completion of the memoryoperation.
 9. The apparatus of claim 4, wherein the controller isconfigured to execute a command to cause the power budget operation tobe performed, and wherein the power budget operation comprises assigninga threshold amount of power to be consumed by memory operations whichare concurrently performed in respective memory regions of the pluralityof memory regions.
 10. The apparatus of claim 4, further comprising abank arbiter coupled to the memory regions and configured to access thememory regions, wherein the controller is configured to execute acommand to cause the power budget operation to be performed based atleast in part on the number of memory regions among the plurality ofmemory regions accessed by the bank arbiter.
 11. The apparatus of claim4, wherein the memory comprises a memory bank including the pluralitymemory regions, wherein the controller is configured to execute acommand to cause the power budget operation to be performed based atleast in part on a number of memory regions within the bank.
 12. Amethod, comprising: setting a counter coupled to a power budget registerof a memory device, wherein the counter has a value corresponding to athreshold number of memory regions that can concurrently perform anoperation; controlling the threshold number of memory regions that canconcurrently perform the operation based, at least in part, oninformation stored in the power budget register; decrementing thecounter while performing the operation associated with a particularmemory region among a plurality of memory regions; incrementing thecounter upon completing the operation associated with the particularmemory region among the plurality of memory regions; and storing aresult of the completed memory operation in the particular memory regionwithout transferring the result of the completed memory operation tocircuitry external to the memory device.
 13. The method of claim 12,further comprising denying the operation associated with the particularmemory region among the plurality of memory regions based on the counterhaving a value less than a minimum number of memory regions that canperform the operation.
 14. The method of claim 12, wherein the powerbudget register is within a bank arbiter coupled to the memory device.15. The method of claim 12, wherein the plurality of memory regions areincluded within a processor-in-memory (PIM) device.
 16. An apparatus,comprising: a memory device comprising a controller and a plurality ofmemory regions, wherein each of the plurality of memory regions includesa plurality of subarrays of memory cells; a bank arbiter coupled to theplurality of memory regions and disposed within the memory device,wherein the bank arbiter comprises a power budget register storinginformation to allow a threshold number of available concurrent datatransfers within the plurality of memory regions by controlling whichmemory regions are to perform the concurrent data transfers; and acounter to store a number corresponding to the threshold number ofavailable concurrent data transfers, wherein the counter is configuredto decrement the stored threshold number during performance of aconcurrent data transfer and wherein the counter is configured toincrement the stored threshold number in response to completion of aconcurrent data transfer, and wherein the controller is configured todirect a data transfer associated with at least one memory region of theplurality of memory regions based on the threshold number of availableconcurrent data transfers without transferring data to circuitryexternal to the memory device.
 17. The apparatus of claim 16, whereinthe controller is configured to receive a command associated with apriority of a data transfer among the threshold number of availableconcurrent data transfers; and the bank arbiter is configured to controltiming of the data transfer among the threshold number of availableconcurrent data transfers based on the priority and the threshold numberof available concurrent data transfers within the plurality of memoryregions.
 18. The apparatus of claim 16, further comprising a pluralityof controllers coupled to the plurality of memory regions, wherein arespective controller among the plurality of controllers is coupled to arespective memory region among the plurality of memory regions.
 19. Theapparatus of claim 18, further comprising a plurality of subarray budgetregisters coupled to the plurality of controllers, wherein a respectivesubarray budget register among the plurality of subarray budgetregisters is coupled to a respective controller among the plurality ofcontrollers.
 20. The apparatus of 19, wherein a respective subarraybudget register among the plurality of subarray budget registers isconfigured to communicate power budget information associated with arespective memory region among the plurality of memory regions to thebank arbiter.